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(54) DEVICE FOR RECOGNIZING VEHICULAR CIRCUMFERENCE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To accurately and inexpensively recognize an obstacle 
having the possibility of contact with a vehicle, and a distance upto the obstacle. 
SOLUTION: A position for measuring a distance is set within a photographing range of 
an image pick-up means for imaging a vehicular circumference, and a focal point of a 
photographing lens of the image pick-up means is adjusted in a range finding position 
based on an image signal from the image pick-up means. A distance upto the range 
finding position is calculated based on a position of the photographing lens and a focal 
distance thereof when focus- adjusted in the range finding position, calculated 
distance information is composed to an image of the vehicular circumference 
image-picked up by the image pick-up means to be displayed. The distance upto the 
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obstacle is accurately recognized without using an expensive distance measuring 
instrument. 
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CLAIMS 



[Claim(s)] 

[Claim 1] An image pick-up means to picturize the perimeter of a car, and a ranging 
location means to set up the location which measures distance in the image pick-up 
range of said image pick-up means, The focus means to which said ranging location is 
made to carry out the focus of the taking lens of said image pick-up means based on 
the video signal from said image pick-up means, A distance calculation means to 
compute the distance to said ranging location based on the location and focal 
distance of said taking lens when carrying out a focus in said ranging location, 
Perimeter recognition equipment of a car characterized by having a display means to 
compound and display the distance information computed with said distance 
calculation means on the image of the perimeter of a car picturized with said image 



pick-up means. 

[Claim 2] Perimeter recognition equipment of a car characterized by installing in the 
part to which the car projected said image pick-up means most in the perimeter 
recognition equipment of a car according to claim 1 so that the optical axis of said 
taking lens may become a road surface and parallel. 

[Claim 3] Perimeter recognition equipment of a car characterized by installing said 
image pick-up means in the bumper of a car posterior part in the perimeter 
recognition equipment for cars according to claim 2. 

[Claim 4] It is perimeter recognition equipment of a car characterized by said ranging 
location means setting up a ranging location for every predetermined spacing in the 
perimeter recognition equipment of a car according to claim 2 or 3 on Chuo Line of the 
vertical direction of the image pick-up range of said image pick-up means. 
[Claim 5] It is perimeter recognition equipment of a car characterized by what said 
display means connects each ranging location by the segment of the color according 
to the distance to each ranging location in the perimeter recognition equipment of a 
car according to claim 4, and is displayed. 

[Claim 6] It is perimeter recognition equipment of a car characterized by what said 
display means connects each ranging location by the segment of the size according to 
the distance to each ranging location in the perimeter recognition equipment of a car 
according to claim 4, and is displayed. 

[Claim 7] It is perimeter recognition equipment of a car which equips with a 
closest-approach point calculation means compute the location and the distance of 
the obstruction nearest to the periphery of a car in the perimeter recognition 
equipment according to claim 4 of a car based on the distance to each ranging 
location which computed with said distance calculation means, and characterizes by 
what that said display means compounds the location of the nearest obstruction, and 
the information on distance on the periphery of a car, and displays on the image of the 
perimeter of a car which picturized with said image pick-up means. 
[Claim 8] It is perimeter recognition equipment of a car which is equipped with a 
rudder-angle detection means detect a steering angle, and a location prediction 
means predict the location of the car periphery after carrying out predetermined 
distance migration with a current steering angle, in the perimeter recognition 
equipment of a car according to claim 7, and is characterized by for said 
closest-approach point calculation means to compute the location and the distance of 
the obstruction nearest to the car periphery of a prediction location. 
[Claim 9] It is perimeter recognition equipment of a car characterized by for the taking 
lens of said image pick-up means being a zoom lens, and for said focus means 
gathering the image pick-up scale factor of said zoom lens, and performing a focus in 
the perimeter recognition equipment of a car given in one term of claims 1-8. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the perimeter recognition equipment 
of a car which displays the situation of the perimeter of a car used as an operator's 
dead angle on the display of the vehicle interior of a room. 
[0002] 

[Description of the Prior Art] A camera is installed in a car posterior part, car back is 
picturized, and the perimeter recognition equipment of a car which displays the image 
of car back on the monitor of the vehicle interior of a room is known (for example, 
refer to JP,10-181447,A). As shown in drawing 1 , car back is picturized and the 
indexes 3a and 3b which show the distance from a car body 1 are expressed on the 
image 2 of the picturized car back as this equipment in piles so that a part of car body 
(bumper) 1 may be copied with the camera attached in the car posterior part. An 
operator can read in range indexes 3a and 3b the distance to the obstruction 4 
projected on the image 2 of car back. 
[0003] 

[Problem(s) to be Solved by the Invention] However, with the conventional perimeter 
recognition equipment of a car mentioned above, since range indexes 3a and 3b are 
displayed on the basis of the road surface, not the actual distance L1 (= 1m) until a 
bumper 1 contacts an obstruction 4 but the distance L2 (= 2m) of index 3b which has 
lapped with the obstruction 4 may be read, and it may take for a twist actually having 
an obstruction 4 in the distance. Furthermore, when many obstructions exist, there is 
a problem that are hard to recognize the physical relationship of a screen to a car and 
an obstruction correctly, and the distance to which obstruction takes it more often 
since an operator has to read whether there is any possibility of contacting which 
location of an obstruction, by the shortest on the basis of the road surface displayed 
on the screen. 

[0004] In order to solve such a problem, distance measuring equipment, such as a 
laser radar, can be used, the distance to an obstruction can be detected correctly, but 
since equipment becomes expensive, adoption is difficult. 

[0005] The purpose of this invention is to offer the cheap perimeter recognition 
equipment of a car which can recognize correctly the distance to an obstruction with 
a possibility that a car may contact, and its obstruction. 
[0006] 

[Means for Solving the Problem] If it matches with drawing 2 and drawing 26 which 
show the configuration of the gestalt of 1 operation and this invention is explained (1) 
Invention of claim 1 An image pick-up means 1 1 to picturize the perimeter of a car, 



and a ranging location means 15 to set up the location which measures distance in the 
image pick-up range of the image pick-up means 1 1, The focus means 1 1 to which a 
ranging location is made to carry out the focus of the taking-lens 1 1 a of the image 
pick-up means 11 based on the video signal from the image pick-up means 11 t A 
distance calculation means 1 1 to compute the distance to a ranging location based on 
the location and focal distance of taking-lens 11a when carrying out a focus in a 
ranging location. It has display means 14 and 15 to compound and display the distance 
information computed with the distance calculation means 1 1 on the image of the 
perimeter of a car picturized with the image pick-up means 11, and this attains the 
above-mentioned purpose. 

(2) Install the perimeter recognition equipment of a car of claim 2 in the part to which 
the car projected the image pick-up means 1 1 most so that the optical axis of 
taking-lens 1 1a may become a road surface and parallel. 

(3) The perimeter recognition equipment for cars of claim 3 installs the image pick-up 
means 1 1 in the bumper of a car posterior part. 

(4) The perimeter recognition equipment of a car of claim 4 sets up a ranging location 
for every predetermined spacing with the ranging location means 15 on Chuo Line of 
the vertical direction of the image pick-up range of the image pick-up means 11. 

(5) With the display means 14 and 15, the perimeter recognition equipment of a car of 
claim 5 connects each ranging location with the segment of the color according to the 
distance to each ranging location, and displays it. 

(6) With the display means 14 and 15, the perimeter recognition equipment of a car of 
claim 6 connects each ranging location with the segment of the size according to the 
distance to each ranging location, and displays it. 

(7) The perimeter recognition equipment of a car of claim 7 is equipped with a 
closest-approach point calculation means 15 compute the location and the distance 
of the obstruction nearest to the periphery of a car, based on the distance to each 
ranging location computed with the distance calculation means 11, compounds the 
location of the nearest obstruction, and the information on distance on the periphery 
of a car, and displays them with display means 14 and 15 at it on the image of the 
perimeter of a car which picturized with an image pick-up means 1 1. 

(8) The perimeter recognition equipment of a car of claim 8 is equipped with a rudder 
angle detection means 50 to detect a steering angle, and a location prediction means 
15 predict the location of the car periphery after carrying out predetermined distance 
migration with a current steering angle, and computes the location and the distance of 
the obstruction nearest to the car periphery of a prediction location with the 
closest-approach point calculation means 1 5. 

(9) Taking-lens 11a of the image pick-up means 11 of the perimeter recognition 
equipment of a car of claim 9 is a zoom lens, and the focus means 1 1 gathers the 
image pick-up scale factor of a zoom lens, and is made to perform a focus. 



[0007] Although drawing of the gestalt of 1 operation was used by the term of The 
means for solving a technical problem mentioned above in order to give explanation 
intelligible, thereby, this invention is not limited to the gestalt of 1 operation. 
[0008] 

[Effect of the Invention] (1) According to invention of claim 1, set up the location 
which measures distance in the image pick-up range of an image pick-up means to 
picturize the perimeter of a car, and make a ranging location carry out the focus of the 
taking lens of an image pick-up means based on the video signal from an image 
pick-up means. And since the distance information which computed the distance to a 
ranging location based on the location and focal distance of a taking lens when 
carrying out a focus to a ranging location, and was computed on the image of the 
perimeter of a car picturized with the image pick-up means is compounded and it was 
made to display, the distance to an obstruction can be recognized correctly, without 
using expensive distance measuring equipment. 

(2) Since according to invention of claim 2 the image pick-up means was installed in 
the part which the car projected most so that the optical axis of a taking lens might 
become a road surface and parallel, the distance to an obstruction with a possibility 
that the lobe of a car may contact can be recognized correctly. 

(3) According to invention of claim 3, since the image pick-up means was installed in 
the bumper of a car posterior part, the distance to the obstruction of car back with a 
possibility that the posterior part bumper of a car may contact can be recognized 
correctly. 

(4) According to invention of claim 4, since the ranging location was set up for every 
predetermined spacing on Chuo Line of the vertical direction of the image pick-up 
range of an image pick-up means, the distance to all obstructions with a possibility 
that the part which cars, such as a bumper, projected most may contact can be 
recognized correctly. 

(5) Since each ranging location is connected with the segment of the color according 
to the distance to each ranging location and it was made to display according to 
invention of claim 5, it becomes easy to check the obstruction near a car by looking. 

(6) Since each ranging location is connected with the segment of the size according to 
the distance to each ranging location and it was made to display according to 
invention of claim 6, it becomes easy to check the obstruction near a car by looking. 

(7) According to invention of claim 7, compute the location and distance of the 
obstruction nearest to the periphery of a car based on the distance to each ranging 
location. Since the location of the nearest obstruction and the information on distance 
are compounded on the periphery of a car and it was made to display on the image of 
the perimeter of a car picturized with the image pick-up means at it The location of 
the high obstruction of possibility that a car periphery will contact, and the distance to 
the obstruction can be recognized at a glance, and contact with a grip or the 



obstruction which becomes empty can be certainly avoided for the distance to an 
obstruction. 

(8) Since according to invention of claim 8 the location of the car periphery after 
carrying out predetermined distance migration with a current steering angle is 
predicted and the location and distance of the obstruction nearest to the car 
periphery of a prediction location were computed After carrying out predetermined 
distance migration with the present steering angle, the location of the high obstruction 
of possibility that a car periphery will contact, and the distance to the obstruction can 
be recognized at a glance, and contact with an obstruction can be avoided certainly. 

(9) Distribution of the high frequency component which the boundary of the color of 
an image becomes clear since the taking lens of an image pick-up means is used as a 
zoom lens according to invention of claim 9, the image pick-up scale factor of a zoom 
lens is gathered and it was made to perform a focus, and is contained in a video signal 
can become steeper, and a ranging location can be made to be able to carry out a 
focus more correctly than the camera of the taking lens of a fixed focal distance, 
therefore the distance to a ranging location can be found more correctly. 

[0009] 

[Embodiment of the Invention] Gestalt» of implementation of the 1st of «invention 
Drawing 2 is drawing showing the 1 st configuration of the gestalt of operation. The 
back camera 11 is equipped with taking-lens 11a (refer to drawing 7 ) and a CCD 
sensor (un-illustrating), is attached in a car posterior part, and picturizes car back. 
This camera 1 1 is equipped with the automatic focus function, can make the location 
of the arbitration of the image pick-up range, i.e., a field, able to carry out the focus of 
the taking-lens 11a, can double a focus, and detects the photography distance to a 
focus location based on the focal distance and lens location of taking-lens 11a. With 
the gestalt of this operation, the photography distance to the focus location detected 
with the camera 1 1 is used as a distance to the obstruction of car back. About the 
approach the automatic focus function of a camera detects photography distance, it 
mentions later. 

[0010] The shift sensor 12 detects the setting location of the shift lever of a change 
gear (un-illustrating). An ignition switch 13 is turned on if the ignition key of a car is 
set as on position. A monitor 14 displays the distance information to the obstruction 
of car back while displaying the image of the car back picturized with the camera 1 1. 
[0011] A controller 15 is equipped with circumference components, such as CPU15a 
and memory 15b, and performs image pick-up control of a camera 11 and a monitor's 
14 display control. A controller 15 sets up the location (it is hereafter called a ranging 
location) which is going to measure distance in the image pick-up range of a camera 
1 1, inputs the photography distance to the ranging location detected with the camera 
11, and compounds and displays it on a monitors 14 car back image as distance 
information to the obstruction of car back. 



[0012] Drawing 3 shows the image pick-up range of the camera 1 1 seen from the car 
side in a parking lot, and drawing 4 shows the image pick-up range of the camera 1 1 
seen from the car upper part in a parking lot. With the gestalt of this operation, a 
camera 1 1 is installed in the bumper which the car posterior part projected most so 
that the optical axis 21 of taking-lens 11a may become a road surface and parallel. 
The vertical image pick-up range 22 (refer to drawing 3 ) and the vertical horizontal 
image pick-up range 23 (refer to drawing 4 ) of a camera 1 1 are decided with the 
taking lens of a camera 1 1 etc. In addition, 24 is the wall of a parking lot. 
[0013] Drawing 5 is the image of the car back picturized with the camera 1 1 in the 
parking lot shown in drawing 3 and drawing 4 . Since the camera 1 1 is installed so that 
an optical axis 21 may become a road surface and parallel against the bumper of a car 
posterior part, the image of the car back picturized with the camera 1 1 turns into an 
image seen from the height of a bumper. 

[0014] Drawing 6 is a flow chart which shows the image-processing program 
performed by the controller 16. This flow chart explains actuation of the gestalt of 1 
operation. It checks whether the ignition switch 1 3 of a car turns on, and in step 1 , if 
the ignition switch 13 turns on, it progresses to step 2, and if turned off, this image 
processing will be ended. 

[0015] In step 2, it checks whether the shift lever is set as the retreat (R) location by 
the shift sensor 12, when set as the retreat location, it progresses to step 3, 
otherwise, it returns to step 1 . When the shift lever is set to the retreat location, a 
ranging location is moved to the left end of the center of the vertical direction of the 
image pick-up range of a camera 1 1 at step 3. 

[0016] Since the camera 11 was installed in the bumper projected to the method of 
the very back of a car posterior part with the gestalt of this operation so that the 
optical axis 21 of taking-lens 11a might become a road surface and parallel as 
mentioned above, the image of the car back picturized with the camera 1 1 turns into 
an image seen from the height of a bumper, as shown in drawing 5 , and serves as a 
location along which the optical axis 21 of a camera 1 1 passes [ the core of an image ]. 
Therefore, the body projected on Chuo Line of the vertical direction of an image is a 
body in the height of the bumper of a self-vehicle, and when it retreats, it is the body 
which contacts first the bumper projected at the self-vehicle posterior part, i.e., an 
obstruction. 

[0017] So, with the gestalt of this operation, along Chuo Line of the vertical direction 
of the image pick-up range of a camera 1 1 , a ranging location is moved at intervals of 
predetermined from the left end of the image pick-up range to a right end, and the 
distance to an obstruction is measured for every ranging location. 
[0018] Next, the focus of taking-lens 1 1a is performed so that the focus of the image 
in a ranging location may suit at step 4. At continuing step 5, the distance to the 
obstruction in a ranging location is measured, and it memorizes to memory 15b. 



[0019] Here, based on a video signal, the focus condition of taking-lens 11a is 
detected, and how to make a ranging location carry out the focus of the taking-lens 
11a, and measure photography distance is explained. 

[0020] Drawing 7 shows the physical relationship (a) of taking-lens 1 1 a of a camera 1 1 , 
and a non-illustrated CCD sensor (image sensor), and the relation (b) between a CCD 
sensor location and the high frequency component of an image. It decreases, so that 
from drawing, and taking-lens 1 1a becomes max in the focus condition which carries 
out image formation of the sharp photographic subject image on a CCD sensor and 
the high frequency component of the video signal outputted from a CCD sensor 
generally has the image formation location of taking-lens 1 1a before a CCD sensor or 
in back. 

[0021] Then, the high frequency component contained in a video signal is extracted, 
and if the location of taking-lens 1 1a is adjusted so that a high frequency component 
may become max, a distance measurement location can be made to carry out the 
focus of the taking-lens 1 1a. For example, as shown in drawing 8 a, when the location 
of a CCD sensor is before a focus location (i.e., when taking-lens 11a is in the 
condition of tying an image back sharper than a CCD sensor), taking-lens 11a can 
acquire the focus condition tie a sharp image on a CCD sensor, by letting out 
taking-lens 1 1a toward the direction which the high frequency component of a video 
signal increases as shown in drawing 8 b and drawing 8 c, i.e., the front of a camera 1 1 . 
Moreover, although illustration is omitted, when the location of a CCD sensor is more 
back than a focus location (i.e., when taking-lens 11a is in the condition of tying a 
sharp image before a CCD sensor), taking-lens 1 1a can acquire the focus condition of 
tying a sharp image on a CCD sensor, by rounding taking-lens 11a toward the 
direction which the high frequency component of a video signal increases, i.e., the 
back of a camera 1 1. 

[0022] The distance to the ranging location at the time of making the ranging location 
of the image pick-up range carry out the focus of the taking-lens 1 1a is found by the 
operation based on a lens location and a focal distance with the taking lens of a fixed 
focal distance. Moreover, with the camera which used the zoom lens for the taking 
lens, distance is found based on the focal distance found from the location of the 
zooming lens for changing a focal distance, and the location of the focusing glass 
which performs a focus. 

[0023] In addition, distribution of the high frequency component which the boundary of 
the color of an image becomes [ the direction which zoomed in with the camera 
equipped with the zoom lens, expanded the narrow image pick-up range and was 
picturized ] clear, and is contained in a video signal can become steeper, and a ranging 
location can be made to be able to carry out a focus more correctly than the camera 
of the taking lens of a fixed focal distance, therefore the distance to a ranging location 
can be found more correctly. 



[0024] Drawing 9 is a flow chart which shows the routine which measures the distance 
to a ranging location. This flow chart explains the measurement approach of the 
distance to a ranging location. It asks for the high frequency component HO of the 
image acquired in the taking-lens location of arbitration in step 1 1. At continuing step 

12, only default value moves a taking-lens location back. It asks for the high frequency 
component H1 of the image after changing a taking-lens location at step 13. 
[0025] In step 14, it checks whether the difference of the high frequency components 
HO and H1 of the image after changing before changing a taking-lens location is 
smaller than the predetermined value epsilon. When the variation of the high 
frequency component of the image before and behind taking-lens migration is smaller 
than the predetermined value epsilon, it progresses to step 1 5, and it judges that 
taking-lens 1 1a is carrying out the focus to the ranging location, and the distance to a 
ranging location is calculated based on the location and focal distance of taking-lens 
11a in the focus condition of connecting a sharp image to a CCD sensor place. 
[0026] On the other hand, when the variation of the high frequency component of the 
image before and behind taking-lens migration is beyond the predetermined value 
epsilon, it progresses to step 16, and the lens migration direction is determined with 
reference to the lens trolley table shown in drawing 10 , and taking-lens 1 1a is moved. 
At continuing step 17, the high frequency component HO before lens migration is 
updated by the high frequency component H1 after lens migration, it returns to step 

13, and the above-mentioned processing is repeated. 

[0027] After finding the distance to a ranging location, it checks whether the ranging 
processing mentioned above to the right end of the image pick-up range in step 6 of 
drawing 6 has been ended, and when ranging processing is not ended to a right end, it 
progresses to step 9, and only predetermined spacing carries out horizontal migration 
of the ranging location to the right-hand side of the image pick-up range. Then, 
ranging is performed to return and a new ranging location to step 4. 
[0028] In addition, although the gestalt of this operation shows the example which is 
made to move a ranging location to a right end from the left end of the image pick-up 
range, and performs ranging, you may make it move to a left end from a right end. 
[0029] Drawing 1 1 shows the ranging result of the car back in a parking lot. Ranging 
for every predetermined spacing is performed from the left end 25 of the horizontal 
image pick-up range 23 to a right end 26, and if the distance to the obstruction 
measured in each ranging location is connected in order, Rhine f1 as shown in drawing 
12 can be drawn. This Rhine f 1 is Rhine showing the distance to the obstruction which 
exists in the height of the bumper of car back, and, below, it will be called "obstruction 
Rhine." 

[0030] When it ranges from the left end of the image pick-up range 23 to a right end, 
the distance of each ranging location is read from memory 10b at step 7 of drawing 6 , 
and it changes in perspective according to the image of a camera 1 1 . 



[0031] Here, drawing 13 - drawing 15 explain how to change obstruction Rhine f1 
showing the distance to the obstruction of car back into Rhine seen from the view of 
a camera 1 1 in perspective. 

[0032] In drawing 13 , distance from the location f2 of a camera 1 1 to the point I on 
obstruction Rhine f1 is set to L Based on the camera location f2 f the point I on 
obstruction Rhine f1 is changed into the coordinate of the point P on the image f3 of a 
camera 11. Although an image f3 carries out image formation behind taking-lens 11a 
of a camera 1 1 in fact, the focal location of taking-lens 1 1 a is placed on the x-y flat 
surface of z= 0 for explanation, and an image f3 is placed between obstruction Rhine 
f1 and the camera location f2 here. 

[0033] As shown in drawing 14 , the location f2 of a camera 1 1 is set to (Xc, Yc, Xc), 
and the field angle of thetaw and a perpendicular direction is set to thetah for the 
horizontal field angle of taking-lens 11a. Moreover, width of face of the image f3 
picturized with the camera 1 1 is set to W, and height is set to H. As the point I on 
obstruction Rhine f 1 which is in distance L from a camera 1 1 shows drawing 15 , it 
asks for the width of face w on an image f3, and height h as a thing corresponding to 
the point P in the location of distance h from the left end on the image f3 of a camera 
1 1 to the distance w, and upper limit. 

[0034] First, it asks for the z-coordinate Zi of Point I. A degree type is materialized by 
the Pythagorean proposition. 
[Equation 1] 

Zi is calculated with the (Zi-Zc)*(Zi-Zc)+Yc*Yc=L*L formula 1 . Next, it asks for the 
y-coordinate of Point P. A degree type is materialized from physical relationship. 
[Equation 2] 

Zs=Yc*tan(2-thetah [ pi/]/2)+Zc, Yps=Yc*(Zs-Zp)/(Zs-Zc), Ype=(Zp-Zc) 
*tan(thetah/2)+Yc, and Ypi=Yc*(Zi-Zc)/(Zp-Zc) 

From this, the distance h from the upper limit of an image f3 to Point P is found. 

Namely, [Equation 3] 

h=H*(Ype-Ypi)/(Ype-Yps) 

[0035] Similarly, a degree type is materialized also about the distance w from the left 
end of an image f3 to Point P. 

[Equation 4] (Xi-Xc)*(Xi-Xc)+(Zi-Zc)*(Zi-Zc)=L*L, Xps=Xc-Zc*tan (thetaw/2), 
Xpe=Xc+Zc*tan (thetaw/2), Xpi=(Xi-Xc)*(Zi-Zp)/(Zi-Zc) 
Distance w is found from this. 
[Equation 5] 

w=W*(Xpi-Xps)/(Xpe-Xps) 

Obstruction Rhine f1 seen from the car upper part is convertible for obstruction Rhine 
f1' on the camera image f3 by performing the operation mentioned above about all the 
points I on obstruction Rhine f1, and searching for the coordinate (w, h) of the point P 
on the corresponding image f3. 



[0036] Drawing 16 shows obstruction Rhine ft' changed in order to put on the image 
f3 of a camera 11. According to the conversion approach mentioned above, the front 
camera 1 1 side expands the longitudinal direction of the image pick-up range 23 of the 
camera 1 1 shown in drawing 1 2 , and it is conversely reduced as it keeps away from a 
camera 1 1. A lengthwise direction is reduced to coincidence as it keeps away from the 
front camera 1 1 side far away, the image pick-up range after conversion turns into the 
range of 27, and obstruction Rhine after conversion becomes fT. In addition, in 
drawing 16 , a segment 28 shows the result of having changed the segment of the 
same die length put on the lengthwise direction at equal intervals, and, thereby, can 
understand the conversion result of the distance of the lengthwise direction of the 
image pick-up range. 

[0037] Next, in step 8 of drawing 6 , obstruction Rhine fT after changing into the 
image of the car back shown in drawing 5 picturized with the camera 1 1 is 
compounded, and it displays on a monitor 14. At this time, obstruction Rhine fT is 
displayed in red. An example of a display result is shown in drawing 17 . Since the 
camera 1 1 is attached so that an optical axis may become a road surface and parallel 
against the bumper of a car posterior part with the gestalt of this operation, as 
mentioned above, the body on Chuo Line of the vertical direction of the image 
picturized with the camera 1 1 is the obstruction of the height of a bumper, therefore 
obstruction Rhine f 1 ' becomes the straight line of the center of the vertical direction 
of an image. If the above image processing is ended, return and the processing 
mentioned above will be again repeated to step 1. 

[0038] Since the bumper which the self-vehicle posterior part projected most 
compounds obstruction Rhine fT showing the obstruction which contacts first on the 
image of the car back picturized with the camera 1 1 and it was made according to the 
gestalt of this operation to display on it as shown in drawing 17 While the distance 
from the lower limit of a back image to obstruction Rhine fT expresses the distance 
from a posterior part bumper to an obstruction, is [ a sense of distance to an 
obstruction ] grip-easy and retreats, the operation in the case of advancing to a 
parking lot etc. becomes easy. 

[0039] If red R and middle distance are classified by color in yellow Y, a long distance 
is classified by color in blue B and a short distance is displayed, corresponding 
obstruction Rhine fT to the distance to an obstruction as shown in drawing 1 8 , it will 
become easy to check the obstruction near a car by looking. Moreover, you may make 
it change the size of obstruction Rhine fT according to the distance to an obstruction, 
as shown in drawing 19 . Furthermore, you may make it change the color and size of 
obstruction Rhine fT according to the distance to an obstruction. Or you may make it 
change the lightness of the foreground color of obstruction Rhine fl' according to the 
distance to an obstruction. 

[0040] Gestalt» of implementation of the 2nd of «invention The gestalt of the 2nd 



operation as which a self-vehicle posterior part periphery detects and displays the 
location of the obstruction which approaches most, and the distance to the 
obstruction is explained. In addition, the configuration of the gestalt of this 2nd 
operation is the same as the configuration of the gestalt of the 1 st operation shown in 
drawing 2 , and omits explanation. 

[0041] Drawing 20 is a flow chart which shows the 2nd image-processing program of 
the gestalt of operation. In addition, the same step number is attached to the step 
which performs the same processing as the program shown in drawing 6 , and it 
explains focusing on difference. If ranging ends the Chuo Line top of the vertical 
direction of the image pick-up range from a left end to a right end at step 6, it will 
progress to step 6A, and the closest-approach point of a self^vehicle posterior part 
periphery and the obstruction of car back is detected. 

[0042] Suppose that obstruction Rhine f1 as shown in drawing 21 was obtained in the 
range measurement to the obstruction of the car back mentioned above. In addition, 
f4 in drawing is the periphery line of a self-vehicle posterior part. The information on 
the installation location of the periphery line f4 of this car and a camera is beforehand 
memorized to memory 1 5b of a controller 1 5. As shown in drawing 22 , while setting up 
m points E1-Em on obstruction Rhine f1, n points C1-Cn are set up on the car 
periphery line f4. And the distance Lij between the point Ej G = 1~m) of the arbitration 
on obstruction Rhine f1 and the point Ci (i=1-n) of the arbitration on the car periphery 
line f4 is calculated. If distance Lij is calculated to all the combination of Point Ej and 
Point Ci, the distance Lij for two shortest points in them will be searched, and those 
two points will be made into a closest-approach point. 

[0043] Drawing 23 is a flow chart which shows closest-approach check appearance 
processing. In step 21, n points Ci (i=1-n) are set as m points Ej 0=1 -m) and car 
periphery lines f4 on obstruction Rhine f1, respectively, i and j are reset to initial value 
1 at continuing step 22. The distance Lij between two-point Ci-Ej of the arbitration 
between obstruction Rhine f1 and the car periphery line f4 is calculated at step 23, 
and it stores in Distance Table T as shown in drawing 24 . 

[0044] When checking whether the distance operation has been ended and having not 
ended to the termination Em of j=m f1 , i.e., obstruction Rhine, at step 24, it progresses 
to step 26. At step 26, j is incremented and return and the above-mentioned distance 
data processing are repeated to step 23. When the termination Em of obstruction 
Rhine f 1 is reached, it progresses to step 25, it checks whether the distance operation 
has been ended to the termination Cn of i=n f4, i.e., a car periphery line, and when 
having not ended, it progresses to step 28. At step 28, while setting 1 as j, i is 
incremented and return and the above-mentioned distance data processing are 
repeated to step 23. 

[0045] When a distance operation is ended in all the combination of the point Ej on 
obstruction Rhine f1, and the point Ci on the car periphery line f4, the minimum value 



is looked for out of the distance operation value stored in Distance Table T at step 27. 
At step 29, it reads, Point Ej Ej, i.e., the closest-approach point, on obstruction Rhine 
f1 corresponding to the minimum distance, and it is changed into the point on 
obstruction Rhine fT seen from the view of a camera 1 1 at continuing step 30. 
[0046] It changes into obstruction Rhine fT which looked at obstruction Rhine f1 from 
the view of a camera 1 1 by the conversion approach mentioned above in step 7 of 
drawing 20 . And as shown in drawing 25 , it compounds on the image of the car back 
which picturized changed obstruction Rhine fT with the camera 11, and expresses on 
a monitor 14 as step 8. Furthermore, the closest-approach point mark 40 is displayed 
on the upper obstruction Rhine fT closest-approach point Ej, and the inverse video of 
the window 41 with which the distance to the closest-approach point of "2.7m of 
closest-approach points" is expressed near it is carried out. 

[0047] According to the gestalt of this operation, the location of the high obstruction 
of possibility that a self-vehicle posterior part periphery will contact, and the distance 
to that obstruction can be recognized at a glance, and contact with a grip or the 
obstruction which becomes empty can be certainly avoided for a sense of distance to 
an obstruction. 

[0048] Gestalt» of implementation of the 3rd of «invention The migration locus of a 
car is predicted and the gestalt of the 3rd operation as which the car periphery line 
after predetermined distance migration detects and displays the location on 
obstruction Rhine approached most is explained. 

[0049] Drawing 26 shows the 3rd configuration of the gestalt of operation. In addition, 
the same sign is attached to the same device as the 1st configuration of the gestalt of 
operation shown in drawing 2 , and it explains focusing on difference. The rudder angle 
sensor 50 detects the steering angle theta of a steering wheel. 

[0050] A controller 15 predicts the location of car periphery line f4 f when carrying out 
predetermined distance retreat with the present steering angle theta from the 
location of the present car periphery line f4, as shown in drawing 27 . And car 
periphery line f4' in a prediction location and obstruction Rhine f1 detect and display 
the point (closest-approach point) of approaching most. In addition, the operation 
approach of this closest-approach point omits explanation from ** which is the same 
approach as the gestalt of the 2nd operation mentioned above. 

[0051] Drawing 28 is a flow chart which shows the 3rd image-processing program of 
the gestalt of operation. In addition, the same sign is attached to the step which 
performs the same processing as the program shown in drawing 6 , and it explains 
focusing on difference. If ranging from a left end to a right end ends the Chuo Line top 
of the vertical direction of the image pick-up range at step 6, it will progress to step 
6B, and the rudder angle sensor 50 detects the steering angle theta, and the location 
of car periphery line f4' when carrying out predetermined distance retreat from the 
location of the current car periphery line f4 with the current steering angle theta is 



predicted, next — a step — six — A — prediction — a location — it is — a car — a 
periphery — a line — f — four — ' — an obstruction — Rhine — f — one — most — 
approaching — a point (closest-approach point) — detecting — an obstruction — 
Rhine — f — one — a top — a closest approach — a point — a camera — 11 — a 
view — from — having seen — an obstruction — Rhine — f — one — ' — a top — a 
point — changing . 

[0052] It changes into obstruction Rhine fT which looked at obstruction Rhine f1 from 
the view of a camera 1 1 by the conversion approach mentioned above in step 7 of 
drawing 28 . And as shown in drawing 29 , it compounds on the image of the car back 
which picturized changed obstruction Rhine f 1 ' with the camera 1 1 , and expresses on 
a monitor 14 as step 8. Furthermore, the closest-approach point mark 40 is displayed, 
respectively on the closest-approach point Ci on obstruction Rhine f1 'the upper 
closest-approach point Ej and the prediction car periphery line f4\ and the inverse 
video of the window 41 with which the distance between the closest-approach points 
Ej and Ci of "1.6m of closest-approach points" is expressed near it is carried out. 
[0053] According to the gestalt of this operation, after carrying out predetermined 
distance migration with the present steering angle, the location of the high obstruction 
of possibility that a self-vehicle posterior part periphery will contact, and the distance 
to that obstruction can be recognized at a glance, and contact with a grip or the 
obstruction which becomes empty can be certainly avoided for a sense of distance to 
an obstruction. 

[0054] In addition, although the gestalt of each operation mentioned above shows the 
example which installs a camera 1 1 in a car posterior part, and picturizes and displays 
the image of car back required at the time of parking, a camera is installed in the front, 
the side, or the back side of a car, also when picturizing and displaying the image of 
the front of a car, the side, and slanting back, this invention can be applied, and the 
same effectiveness is acquired. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is drawing explaining the trouble of a Prior art. 

[Drawing 2] It is drawing showing the configuration of the 1st of the gestalt of 
operation of invention. 

[Drawing 3] It is drawing showing the image pick-up range of the camera seen from 
the car side in a parking lot. 

[Drawing 4] It is drawing showing the image pick-up range of the camera seen from 
the car upper part in a parking lot. 



[Drawing 5] It is drawing showing the image of the car back picturized with the camera 
in the parking lot shown in drawing 3 and drawing 4 . 

[Drawing 6] It is the flow chart which shows the 1st image-processing program of the 
gestalt of operation. 

[Drawing 7] It is drawing for explaining the focus approach of a camera. 

[Drawing 8] It is drawing for explaining the focus approach of a camera. 

[Drawing 9] It is the flow chart which shows the routine which measures the distance 

to a ranging point. 

[Drawing 10] It is drawing showing the lens migration direction table. 
[Drawing 1 1] It is drawing showing the ranging result of the car back in a parking lot. 
[Drawing 12] It is drawing showing obstruction Rhine seen from the car upper part. 
[Drawing 13] It is drawing for explaining how to change obstruction Rhine f 1 seen from 
the car upper part into obstruction Rhine f 1 ' seen from the view of a camera. 
[Drawing 14] It is drawing for explaining how to change obstruction Rhine f 1 seen from 
the car upper part into obstruction Rhine fT seen from the view of a camera. 
[Drawing 15] It is drawing for explaining how to change obstruction Rhine f 1 seen from 
the car upper part into obstruction Rhine fT seen from the view of a camera. 
[Drawing 16] It is drawing showing obstruction Rhine f1 ' changed in order to put on the 
image of a camera. 

[Drawing 1 7] It is drawing showing an example which compounded and displayed 
obstruction Rhine on the image picturized with the camera. 

[Drawing 18] It is drawing showing an example which classified by color and displayed 
obstruction Rhine according to the distance to an obstruction. 

[Drawing 19] It is drawing showing an example which changed the size of obstruction 
Rhine according to the distance to an obstruction. 

[Drawing 20] It is the flow chart which shows the 2nd image-processing program of 
the gestalt of operation. 

[Drawing 21] It is drawing showing the relation between obstruction Rhine and a car 
periphery line. 

[Drawing 22] It is drawing for explaining the detection approach of the 
closest-approach point of a self-vehicle posterior part periphery and the obstruction 
of car back. 

[Drawing 23] It is the flow chart which shows closest-approach check appearance 
processing. 

[Drawing 24] It is drawing showing a Distance Table. 

[Drawing 25] It is drawing showing an example which gave a synthetic indication of 
obstruction Rhine and the closest-approach point on the image of car back. 
[Drawing 26] It is drawing showing the 3rd configuration of the gestalt of operation. 
[Drawing 27] It is drawing for explaining how predicting the location of the car 
periphery line when carrying out predetermined distance retreat. 



[Drawing 28] It is the flow chart which shows the image processing of the gestalt of 
the 3rd operation. 

[Drawing 29] It is drawing showing an example which gave a synthetic indication of the 
closest-approach point of obstruction Rhine and a prediction car periphery line on the 
image of car back. 
[Description of Notations] 

1 1 Camera 
11a Taking lens 

12 Shift Sensor 

13 Ignition Switch 

14 Monitor 

15 Controller 
15a CPU 
15b Memory 

21 Optical Axis 

22 The Image Pick-up Range of Vertical 

23 Horizontal Image Pick-up Range 

24 Wall 

25 Left End of Horizontal Image Pick-up Range 

26 Right End of Horizontal Image Pick-up Range 

27 Image Pick-up Range after Conversion 

28 Segment 

40 Closest-Approach Point Mark 

41 Window 

50 Rudder Angle Sensor 
f1 Obstruction Rhine 

f1' Obstruction Rhine seen from the 4 view of a camera 

f2 Location of a camera 

f3 Image picturized with the camera 

f4 Car periphery line 

f4' Prediction car periphery line 
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